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Abstraect 



In this paper 12 blind trans.f ormation procedures are applied to 
18 data Sets. The*results of the analyses indicate that the orthotran 
transfoymation solution is- not restricted to particular types of data as 
are so many other transformation solutions/ ^ 

The evidence presented in this paper strongly suggests that the 
orthotran solution must be considered as the best blind arralyi^tic oblique 
tran^ormation procedure presently available for general use. That is,, 
the orthotran solution can be-used-by the average educational researcher 
v/ithout the bothersome consideration of the general nature of the factor 
matrix to be transformed. 
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Paper presented at the annual meeting of the American Educational 
Research Association^ in Washington, D. C. —April, 1975^ 



The major objective of this study was one of in\(estigating fh'e data 
general izabij ity of a new^blind transforr^ation procedure, th6 orthotran solu- 
tion (Hofmann, 1975). The* orthotran solution is intended .to »be a "workhorse" 
transformation solution. In order to function in this capacity the orthotran , 
must be operational and available for immediate* use, with satisfactory results, 
without the bothersome prior consideVation of the general nature of the factor 
matrix to be transformed, , 

The actual procedures for realizing this objective are much like those 
;for validating a test, at' least conceptually. One validity question is that 
of determining h(^w well an orthotran solution will approximate a subjective 
solution. A second validity question is that of determining whether the 
quality of an orthotran solution is situation specific' A third validity 

i 

question is one of determining whether the orthotran is really "better".* than 
existing tifins format ion procedures in terms of approximating subjective solutions 

Clearly the most important consideration is that of data criteria. Eighteen 
different factor matrices are used in this study. For each factor matrix an 
ideal subjective ^solution has been determined either by the author report;ing 
the factor matrix or by ^ person recognized by the data author as being an 
excellent "rotator." Solutions were determined by Swineford, Lawley, Thurstone, 
Holzinggriind Horn as well as by others. 

Including the orthotran, 12 blind analytic transformation pr)3cedures are 
applied to each of 18 dat^sets. The transformation solutions are summarily 
described by four indices. One of the indices is new and is developed in* 
this paper in order to provide a relative index of the adequacy with which a 
blind solution approximates a subjective solution. 



, The first part of this paper provides brief descriptions of the 12 

♦ * 

blind transformation procedures. The second .section describes the four 
descriptive indices. In the third section the 18 data 'samples are generally 
described with regard to a conceptual universe of factor solutions. Also 
included in this section is a brief description of each data sample. The 
fourth section provides a discussion and summary of the analyses./ ^ 
'I ' Blind Analytic Procedures ^ 

The blind analytic procedures to be discussed in this paper can be 
subdivided into four general categories: S 

(a) the class of oblimin solution; 

Cb^ the class "bf orthomax solutions; 

V^c) the Harris and Kaiser'solutions; 

(d) the orthotran solution. ^ ^ , - 

Whereas the oblimin and orthomax solutions are computejd directly as a 'funplion 
of either maximizing or minimizing some mathematical criterion, the Harris 
and Kaiser solut^'ons, gaining in popularity, are two emiprically basejd solutions, 
while the onxhotran solution is determined primarily ^through the utilization of 
principles of artificial intetTigence. 

The class of orthomax solutions are blind orthogonal soliJtions; the 
class of oblimin solutions tend to be blind oblique sqlutio/is as do the Harris 
and iKaiser solutions. The orthotran tends to determine blind oblique solutions 

but will, by necessity in certain situations, determine solutions identical or 

■* •. 

very similar to those defined by the class of orthomax solutions. All solutions 
are determined as "normalized" solutions, variable vectors assumed to be of 
unit length during the computation process, as opposed to "raw" solutions 
inasmuch as raw solutions just do/not appear to determine as compelling simple 
structure solutions as do the normalized solutions. a 



Orthomax Solutions . The class of orthomax solutions all seek to * 
determine an orthogonal solution that will maximize some specific form of the ^ 
geft^al orthomax criterion (Mulaik, 1972) which is in a. very special sense 
a "weighted" form of the sum of the t columH variances of the squared factor 
coefficients. ^, , ^ ^ 

^ It is the weight value, w., selected th^ determines'^the specific type 
pf orthogonal solution computed. ' The quartimax criterion (Carroll, 1953) is 
defined by (w=0), the varimax criterion (Kaiser, 198!8) is defined by Cw=l), 
the equamax (Saunders, 1962) is defined by^.(w=r/2) and is identical to the 
varimax for a two factor solution. Although w is specifically defined here 
it can, techniccttjly , be set at any^ value. ThWi^study investigated only the , 
values of (0, 1,' r/2) as they represent the, prominent ehoices seVected for use 
in blind orthogonal solutions. ^ " • ' 

Oblimin Solutions : The class of oblimi.n solutions are subdivided into 
two categories: the direct oblimin and the indirect oblimin. The distinction 
between the two being that t"he ^manipulated matrix,, the interpretative matrix 
of interest in the direct oblimin solution, ('Jennrich and Sampson, 1966) is the > 
primary pattern matrix, the set of regression coeffici^ts for estimating 
variable scores from factor scores. The 'manipulated matrix in the indirect 
oblimin solution (Carroll, 1957; Harman, 1967). is the reference structure matrix 
Once a reference structure matrix has been determined it is usually converted 
to a primary pattern matrix for interpretation. 

The objective of the oblimin-type solutions is to minimize a criterion 
which is in a very special sense a weighted form of the r(r-l )/2 ^column 
covariances of the squared entries oV the solution matrix, either a primary 
pattern matrix in the case of a direct oblimin approach or a reference structure 
matrix in the pase of an indirect oblimin approach. 



As with the orthomax cr.iterion the choic-e for w determines the specific 

solution computed. For' the indirect' solution (•w=0) def4nes the^quartimin . 

criterion; (w=.5) defines the biquartimfn criterion,; (w=l) the covarimin ^ t 

/ . • ^ ' 

criterion (Harman, 1967). For thfe direct oblimin, the choice of weights, 

seems %o be in need of clarification, but the most prrominent weights- (Harman, 

^ 1967) would seem tcf- be (0, -.i)5, -1.0) with the zero weight being associated 

with the direct quartimin '(Jennrich & Sampson, 1966). As noted by Harman (1967) 

there seems to be little relat'ionship between the weights of the direct and' in- 

..... . - '0 

direct oblimin with regard to the "quality" of the solution computed. , < 

Although the range of w is somewhat more restricted (Mulaik, 1972) when 
used with the class of oblimin solution, than with the class of orthomax 
solutions there is still a considerable range of choices. The two sets of 
weight previously noted/ {o, -.5, -1; 0,^.5, 1), were selected for use in 
defining the two types of oblimin solutions. Harman (1967) specifies the 
conseqences, sb^ietimes quite, grave, of selecting values outside of the range ^ 
of those used in this study.-. 

Harris and Kaiser Solutibns . The Harris and Kaiser *(1964) solutions 
are two sets of .empirically based equations, derived from the general Harris ^ 
and Kaiser ('l964) orthoblique equations, for the quick and sometimes highly 
^efficient computati.on of oblique factor solutions. 

The two solutions are specified as the independent cluster solution ancj 
the "A'A proportional to L" solution, henceforth (A'A) solution. The correlatiqns 
ar€ reproduced from the initial factor matrix and then resolved into r unit 
length eigenvectors and associated eigenvalues. The independent cluster 
solution, primary pattern matrix, ns a column rescaUng of a raw quartimax , 
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rotation applied to the eigenvectors. The A' A primary, pattern solution 
defined ()y (a) rescaling the columns of the eigenvectors by the fourth root 
of the eigenvalues, (b) applying a raw quartimax rotation to the rescaled 
eigenvectors,, (c) rescaling the columns of the rotated matrix (+larris and 
Kaiser, 1964). . . ' * * • ' ^ 

Orthotran Solution . The orthotran solution v(Hofmann, 1975) is a type 
of ad hoc solution based upon the general orthoblique equations of Harris and 
kaiser (1964). Utilizing principles of artificial intelligence, specifically 
heuristic search procet^res, the orthotran approach determines a 'solution, 
primary pattern, from an infinite solution space. 

Generally, the orthotran solution functions in conjunction with some 
orthogonal transformation solution. For the purposes of this study it was 
used in^conjunction with a normal varima^x solution. as this is the orthogonal 
solution suggested for use as a blind procedure by Hofmann (1975) . 

The orthotran has been programmed and is presentlj^ being considered for 
inclusion in all of the major published computer packages. Eaf^lier versions 
of the orthotran, the obliquimax transforitiation in particular (Hofmann, 1970), 
have been used since 1970 with empirical applications, already in- the published 
literature. 

Descriptive Indices ^ > 
Four descriptive indices are utilized in, this study. Twq 'of the indices* 
are not really new, a third index has just recently been published while the 
fourth index is being described for the first time in this paper.- The Tiew " 
index is descriptive of the degree of congruence one Solution has with another. 
The other thr^e indices represent various ways of surrinarily describing a factor 
transformation solution.^ ' , ^ • . 
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Hyperplane Count ;. 'The hyperplane. count is an attempt to quantify a 
factor solution by describing it in terms of the number of, zero coefficiel^S in 
the solution matrix. It is just the number of coefficients less that .11 in 
magnitude for any given factor solution. It is based >upon Cattell 's (1966) 
notion that for any given sample of variables, "we should "expect any 'true ' 
natural influence to affect only a few of them.V CattelV states that there 
should be a- transformation position for each , factor such that a majority of 
the variables have. zero loadings. • • . 

Unlike the other three indices used in this study the'magnitude of the 
hyperplane count is a function'of both the number of variabiles and number of 
factors. .It may be used for comparisons of different solutions to the same 
factor matrix- 

Average Absolute Factor Intercorrelation , This index unli4;e the other 
indices include'd in this study is defined as a function of the primary factor 
* intercorrelation matrix, as opposed to the primary pattern matrix. It serves- 
as an index of the aveV^age obliquity of a factor solution. 

To compute this index the absolute value of each non-diagonal correlation 
in the primary intercorrelation matri;^ is converted to a* Fisher These values 
*are then averaged. The average Fis+ier z is then cpnverted back to a correlation, 
henceforth average factor intercorrelation, 

■ This lindex is a stable index, being independent of the number of variables 
and the nuni^ of fafctors, and provides a descriptive index for use in comparing 
certain aspects of primary factor solutions within and across different data sets. 

Average Variable Complexity , This index is defined as a function of the 
rows of the primary pattern matrix. In' the linear description of a given variable 
any number, r, of common factors may be involved as long- as (r <"n), Jhis 
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number is referred to as the complexity of the variable- Specifically, ^ariable 
complexity refers to'the number of. factors involved in the "row-wise"* description 
of a variable in a factor matrix (Hofmann, 1976). 

When there is one substantial entry in a row of a factor mat^x, all 



* other row entries being zero, the complexity of t^e variable associated with the 

An 

row is 1. The average variable complexity for a factor solution is just the 
average number of common factors needed to describe' the n variables. 

This index is a stable index, being independent of the .number of variables 
and relatively independent of the number of factors, usually the average variable 
complexity wiTl "range from an absolute low o J. 1 , a true independent cluster 
solution, ta a high of 2.5 to 3.0. Thus, this index ts a descriptor appropri- 
'ate for use in comparing factor solutions both within and between different . 
data sets. v • ' • 

^ , Index of Congruence . This index is intended to be used as a quantitative 
summary of the pattern similarities of * th^ coefficients of two (nxr) solution 
matrices. It is based upon Burt's coefficient of congruence (Cattell, 1966).. 
The formula/for determining the coefficient of congruehce between a 'factor in 
oTie n\atrix and a factor in a sec^d matrix is reported^by Cattell (1966, p. 196). 
The coefficient of congruence serves as an index of the degree of pattern 
similarity-of two factors, having a maximum upper limit of 1.00 and lower limit 
of -1.00. • 

The index of congruence is a s'ingle number with a maximum upper limit of 
1-00 and a lower limit. of 0. It is an index of the degree of pattern similarity 
one matri-x has with another. In this study it is an- index of the a^lequacy 
with which a blind solution approximates a subjective solution. It is. computed 
according to the following steps: 



ERLC 



8 • 

( . ' " 

(a) com|Jute all possible congruence coefficients of the subjective sol- 

ution witlji^ itself •(factor 1 with ijtself, with' factor 2 and so on); 

(K) obtain the sum of the absolute values .of these congruence coefficients 

(they win represent the absoli^e sum of the congruence coefficients 

of the ideal blind solution with tlie subjective solution); 

(c) compute all possible congruence coefficients of a^ blind solution with 
the subjective solution; ^ 

(d) obtain the *sum of the absolute values of these congruence coefficients; 

(e) determine the absolute^difference between the the sum obtained in 
step (b) and^step (d) and call this "error of fit;" - 

(f) express this absolute difference as a ratio to the total of step (b) 
and call it relative error; ) 

(g) subtract the value determined in step (f) from unity to determine the 
relative accuracy and call the resulting number the index of congruence. 

This index will be unity when a blind solution i^ identical to the subj^c- 

' ' * ' * ' 'I 

tive solution. Unfprtunately, this index is subject to the same limitation of 

the coefficient af congruence.' It can give a value of unity for patterns of 

identical shape even though the coefficients may have different levels of 

magnitude. Als6 the ideal' sum may be obtained by more than the one ideal set 

of congruence coefficients. However, to the extent that more than two factors 

are utilized the latter problem is reduced.. ^ 

This index is a stable index and may be used for comparisons of different 

solutions to the same factor matrix. That blind solution having the highest 

index of congruence for a particular data set will be assumed to ^be the* best 

blind approximation to the subjective so-lution of that data set. 

Data Selection / 

Foe illustrative purposes 18 data sets are utilized in this study. Of 

10 



particular concern is the representative nature of these data sets. Although ^ 
^ only intuitive it is felt that tti£se '18 data sets may be fairly representative 



of the universe of possible factor matrices with regard to variable complexity 
and average intercorrelations. A variety of characteristics are manifested by 
these data: number of factors, variable complexities, hyperplane counts, average 
factor intercorrelations, heterogeneity of communal ities, error factors, bi- 
polarity of factors and perhaps still other important yet unrecognized character- 
istics. All data sets selected have associated with them solutions that were 
determined subjectively. These subjective solutions may be thought of as being, 
ideal or criterion solutions. ' - • 

With two exceptions the data are grouped into two general types: plasmodal 
and real. Plasmodal (j^ta (CatteTl , 1966) are generated. by physical models 
having known and easily identified formaj properities similar to those of 
mathematidal models, but they are subject to measurement error and have other 
physical realities not present in abstract mathematically determined data sets. . 
The nature of such data is both well understood and well behaved. ^ 
g The real data are based upon observations on real people v^ith less than 
perfect measuremenit instruments and as such they are prone to nOmerous predictable 
and unpredictable problems. It is of the utmost ijnportance to include such data 
in any generalizability study as ,it is the satisfactory "handling" of a variety , 
of real data that suggests the aeneral izability of a ^transformation procedure. 
When a procedure performs poorly with plasmodal data one can usually identify 

the cause of such poor performance through an intimate knowledge of the nature 

/ 

of the data. Unfortunately, poor^performance with real data is not so easy to 
explain. .For this reason satisfactory performance of a blind tVansfbrmation 
procedure with .a variety of. real data is perhaps more laudable than, satisfactory 
performance, with plasmodal or true artificial data.- 
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Table 1 
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Identification, Descriptions and Source of Illustrative Data Sets ' 






Data Identification 


Data 


Number 




\ 




- 






Type' 


Variables 


Factors 


Sajnple 


< 

Source 




0) 


Thurstone's? Cylinders 


Plasmode 


7 • , 


2 


27' 


Thurstone, 1947 
p; 1\9. 




(2) 


8 Physical Variables 


Real • 


B 


2- 


305 


Holzinger and 
Harman',1941 ,p.2 




(3) 


Swineford 


Real 


' 9 




504. 


Swineford, 1948 
p. 17-18 


• 


(4) 


Law! ey 


Real 


9 


3 


73 


Lawley and 
Maxwell ,1971, F 


* 


(5) 


13 Psychological 


Real 


13 ■ 


• 3 • 


145 


Holzinger and 
. Harman,1941 ,p.5 




(6) 


Cups of Coffee A 


Plasmode 


15 


6' ' 


80 


Cattell and Sul 
van, 1962, 0.191 


(7) 


Cups of Coffee B 
• 


Plasmode 


15 ' - 
• 

» 




80 


<s Cattel 1 , and Sl 
van, 1962, p. 191 




(8) 


Thi jr^ I'Onp * ^ TranP7niH^ 


Pl a ^mnHp 


15 


4 


32 


Thurstone • 1 947 . 
p. 432 • ^ . 




(9) 


Box Problem 


Plasmode 


20 


3 


20 


Th'urst'one,1947, 
p. 136 




(10) 


Horn 


■ Real 


20 . 


5 


172 


Horn, 1963, p. 127 




(11) 


Coan's Eggs 


Plasmofie 


*21 




100 


Coan,1959,p.l58 


« 


(12) 


24 Psychological . 


Real 


2'0 


4 Q 


145 


Holzinger and 
Harman,1941 ,p.2 




(13) 
(14) 

* • 


Thurstone's orthogonal 
Pemberton . 

* * 


Artificial 
Real 


2-5. 
25 


V» 5-' 

♦ r 


h " 

1,54 


Thurstone, 1947, 
p. 254 

Pemberton, 1952, 
• p. 276 
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^ . Table 1 tcofttipued) v 

'p Jdentiflcation, Descriptions and' Source of Illustrative Data Sets 



f ^ ■ 

Data Identification 
» 


Data 


Number 


e 




• 




,j ■ Type . 


Varifibles 


- Factors 


^ample 


Source 


-? — ■ ^ 

(15) Ball Problem • ° 


Plasmode- 


32 


4 ^ . 


• 80 

* 


/ 

Cattell and 
DickmanJ962,Pv 


(16) Degan Data 


. "^' Real 


32 


• • s 


' ■ .367 


Degan, 1952,p.'3 


. (17) Kelley's Data 


. Rea^l 


40 




■ .442 ' 


Keney,1964,p.3 


(18) Hofmann's Oblique 


^^^^^/^ficial 


8 ' 


2 








> 


• < 


—A V" 








i ^ 

% 



/ 
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Two of the' data sets are artificial » from the point of view that the 
factor "solutions were' mathematically determined. Both artificial data sets 
were generated in. order to define extreme average factor intercorrelations. 
One data sfet was generated specifically for this\study in order to ^define an 
average factor intercorrelation of ,99. (It can be obtained by request from the 
author). The second data set was generated by Thurstone (1947) to define an 
average factor intercorrelation of zero. 

Jhe data are identified and partially summarized in Table^l. Their sub-" v. 
jective solutions are summarily described with the (descriptive indi<:es in Tabl6 
2. All descriptions for the subjective solutions are based upon primary pattern 
matrices, ^ ' , ^ 

Conceptual Universe of Factor ^ Solutions . As previously noted two of*the 
descriptive' indices used in this study may be used for intersolution^ comparison: 
average variable complexity and average factor intercorrelation. In Figure 1 
the 18 subjective solutions hav^ been plotted as points in a two-space with 
avera'^e variable complexity, and average factor intercorrelation serving^as 
coordinates. The abcissa is defined according to average variable complexity 
and ranges from 1 .to 2\7 . The ordinate is defined according to averagjB. factor 
intercorrelation and ranges -from 0 to 1.0. .These two* indices are reported in 
Table 2 for the subjective solutions. 

Note that in Figure 1 the solution pjDints tend to be bounded by, a hyperbola 
that becomes as3miptotic to the two axes. The implication of this bound seems 
clear. Generally speaking the greater the obliquity of the solution the lower 
islthe variable complexity, alternatively, the more complex solutions tend 
to be associated 'with relatively uncorrelated factors. A majority of the sol- 
utions tend to have an average correlation less than .50, this observation is 
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FIGURE 1 Cot.ceptual universe of factor solutions 
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supported by Rummel (1970) and Cattell (1966). Also it may be noted that a 
majority of the solutions have an average \^ariab1e complexity less tha-n 2-0. 

The hyperbola has been included in Figure 1 amd that portion of the figure 
between the axes and the hyperbola may be thought of as a conceptual universe 
of factor so>utions. Most properly determined factor^ solutions would fall- 
within that bounded region. 

Discussion and Summary of Analy^eSo ' 

In conducting the analyses of this study the following seguence of steps- 
was adhered to for each (Jata source: 

(a) an orthogonal factor matrix was, obtained from the 1i,terature source, 
usually a centroid solution, with the exception^of data set 18 
which was defined mathematically in a principal axis form determined 
from an artificial factor solution matrix; 

(b) the ^orthogonal matri)^ was subjected systematically to' all 12 blind 
transformation procedures; 

(c) ^the subj^tively determined solution wa^ obtained from the literature 
soqrce and\f it was .an oblique solijtlon/reported as a reference 
structure somtion it was rescaled to a primary pattern solution 
following Thurstone (1947); 

(d) for each solution'the average primary intercorrelation, the hyperplane 
count, and^the average variable complexity was determined (see Table 2); 

(e) each blind t^ansformation solution was compared to the subjective solu- 
tion to determine the index of congruen^, (Final cbjlumn of Table 2), 

In summarizing the results '•for discussion purposes the single most important 
consideration was felt to be one of addressing the adequacy with which the blind 
solutions approximated the subjective solutions. To this end for each data 
set the ^ighedt indexW congruence, the smallest overall percentage of relative 



Table 2. Summary 



Data 



TransformatTon 


Average 
Factor r 


Hvoer- 
plane 
Count 


AveraQe 
Variable' 
• Complexity. 


Index 
of 

Congruence 


^ 

Direct w=0 


30 


1 


1.23 


.85 


Oblimin w=-,5 ' 


-r 24 


1 ' 


1.23 


.82 


"w-1 * 


20 • . 


', 3 


^1.23 


^80 . 


Indirect w=0. 


'48 


0 


1.22 


.79 


Oblimin w=,5 


27 


0 


• 1.24 


.88 


V w=i ; 


00 


3. 


1.32 


'.99 


Quartimax 


CO 


0 


1.24 


.87 


Varimax 


00 


3 


1.32 - 


.99 


A*A 


" 23 


* 1 


'1.49 


.96 


Indep. Cluster 


43 


0 


1.21 


.79" 


Orthotran 


05 


3 


1.31 


.99 


Subjective 


.00 


14 


•1.30 





2 



Direct w=0 47 

Oblimin w=-.5 37 

w=-l 34; 
Indirect w=0 " 01 

Oblimin w=.5 27 

w=l GO 

Quartimax 00 

Varimax 00 

A'A .25 

Indep. Cluster 48 

Orthotran 46' 

Siibjestive 48 



8 
7 

6 

0 

4 

0 

0 

0- 

0* 

8 

8 

8 



1.01 
1.02 
1.02 
1.62 
1.04 
1.14 
1.14 
iJ.14 
1.78 
1.01 
1.01 
1.01 



1.00 
.94 
.92 
.58 
.89 
.78 
.78 
.78 
.60 
1.00 
1.00 



Direct w=0 • 30 

"Oblimin w=-.b 22- 

w=-l 1.8 

Indirect .w=0 42, 

Oblimin w=-.5 19 

w=r 10 



14 
14 
13 
13 
14 



1.16 
J. 16 
1.^16 
^1.15 
1.17 
1.17 



.96 

•98// 

i.oa/ 
r.oo' 

.75. 
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Table 2 Summary (continued) 



Data Transformation 



Average 
-Factor r 



Hyper- 
'plane 
Count 



Average 

Variable 
ft 

Complexity/ 



Index 
of 

Congruence 





Quartimax 


00 . 


12 


1.19 




Varimax 


00 ^ 


12. 


1.34 




Equamax ^ 


00 


' - 7 


1.41 




A»A 


20 


5 


1.54 




Indep- Cluster 


38 


13 


1.16 




Ortho^raa 


• 37 


if" . 


1.16 




S^ibjgctive 

y 

Direct w=0 


74 

• 


15 


1.10 


\ 

4- 


31 


12 ^ 


1.17 




Oblimin w=-.5 f 


26 


H ' 


1.19 






24 


11 


1.19 


Indirect w=0 


45 


11 


1.17 




Ubi imin . w^.o 




9 


\ .c\ 






' . 09 


2 


1.44 




• Quartimax 


00 




1.34 




Varimax 


00 


3 


1.34 




A'A 


00 

« 20 


2 
] 


1.34 
2.34 




Indep- Cluster 


40 ■ 


13 


1.16 




Orthotran 


' 3,9 


11 


1.16 




Subjective 


32 


11 


1.18 


5 


Direct w=0 


48 


, '23 


1.20 




Oblimin w^-'^.B 


49 


19 


1.25 




w=-l 


45 




' 1.30 




Indirect w=0. 


21 


17 


1.14 




Oblimin. w^.B 


16 


18 


1.17 




w=l 


Factor 


Collapse 






Quartimax 


00 


16 


1.25 




Varimax 

* 


.00 


15 


1.28 




Equamax 


00 ,. 


7 


1.88 



.94 
.80 
.91 

.71 
.95 
.98 



.81 ^ 
.79 

.76 t 

.88 

.91 

.82 
.82 
.62 
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Table 2. Summary (Cohtinued) 



Data* 


Transformation 


Average 
Factor r 


Hyper- 
plane 
Count 


Average 
Variable ■ 
Complexity 


Index 
of 

Congruence 


5 




25 


12 


1.69 


.69 




Indep- Cluster 
Ortnotran 


74 
22 


15 

19 


1.48 
1.18 


• -.90 , - 
.93 




Subjective 


50 


19 


1.14 


■ - - 


6 


Direct w=0 


09 


58 


. 1.4; 


.89 • 




Obrlimin W=-,5 


10 • 


54 


1.47 


.96 




' w=-l 


09 


55 


U47 


.96 




Indirect w=0 


49 


24 


.. 2.35 


-.98 • 




Oblimin w=-5 


07 


55 


1.39 


.99 




w=l • 


Factor Co.llapse - 








Quart imax 


00 ■ 


53 


1.40 


' .99 




Van" max 


00 


52 


1.41, 


• 97 




Equamax 


00 


.50 


1.44 


.98 , 




A'A 


07 


22 . 


. 2.28 


.73 

1 




Indep. Cluster 


14 


51 


1.41 


.87 




■ Orthotran 


12 


. 54 


1.36 


.94 


> 


V Subjective 


10 


52' 


1.38 . 


- 




Direct • w=0 


,12 


56 . 


1.32 


.93 




Oblimin w=-.5 




57 


1..34 


.98 






10 


' 58 


1.35 


1.00 




Indirect w=0 


Fa,ctor Collapse 
factor Collapse 








ObTimin w=.5 







w=l 
Quart imax 
Varimax 
Equamax 
A'A 

Indep. Cluster 

Orthotran 

Subjective 



Factor Collapse 
48 
49 
48 
29 
49 
57 ■ 
50 



. 00 
/ 00 
00 

20 
10 
13 



i 



1.38 
1.38 
1.41 
2.43 
1.39 
1,34 
1.39 



.96 
.90 
.84 
.68 
.83 
1.00 
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Table 2. 


Summary (Continued) 




Ua ua 


1 raribTonna L i uii 


Average 

r a u uu 1 1 


Hyper- Average 
plane Variable 
Count Complexity 


Index 
of 

ConQruence 


8 


Direct w=0 


28 


24 


r.6i 


.96 




Oblimin w=-.5 


26 


25 


1.65 


.93 . 




w=-l 


25 




1.68 


.91 




Indirect w=0 


Factor Collapse 








Oblimin w=.5 


Cm Cm 


23" 


• 2.01 


.75 • 




w=l 


in ( 
10 I 




1.59 


- .95 




Quart i max 


no \ 


^15 


.2.0L 


.99 




Varimax 


nn 


la 


t.53 


.79 


- 


Equamax 


no ^ 


■ 13 


,1.84 


.76 




A^A 


23 


15 


^2.01 - 


.85 ^ 




Indep. Cluster 




15 


• il.65 


.94 \ 




Orthotran 


29 » 


26 


*1.62 


.94 f 




Subjective 




• 30 


J. 57' 




' 9 


Direct w=0 


0 1 


27- 


1.40 


^.92 




Oblim^t) w=^-.5 


27 


27 


1.41 


.94 


• 




. 26 


27 -> 1^.41 


.♦95 




Indirect w=0 


?n 

C\J 


• 10 


. 1.94 


.99 




Oblimip w=.5 




27 


1.41 : 


.97 


* 


- w=l 


10 


6 


1.61 


-.83 


. ?• 

\i 


Quart i max 


00 


17 


1.51 


.87 


1 

_( 


Varimax 


Q|p 


15 


1^52 • ' 


.89 




Equamax * , 


00 


. 15 


1.52 


• .89 


/ 


* A'A* 


23 


9 


1.99 , ' 


.92 - 




Indep. Cluster 


44 


■ '6 


' 1.42 


.81 . 




' Orthotran 


- 19 


27 


. 1.42 


-1 .00 




Subjective 


19 


27 


1.43 




10 


Direct * ^ w=0 


11 


47 


^!80 


..97 




Ob]1min w=-.5 


n 


■ 44 


.90 




w=-l 

* • • 

» • 


11 


* ( 


. \ 


.92 
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Table 2'. Summary (Continued 



Data fransformation 



Average 
Factor r 



Hypen- 
p'lahe 
Count 



Average ' 

Variable 

Comp1ex»ity 



Index 
of • 

Congruence 



10 indiryt =0 

Oblimin w='.£ 

w=1 
Quartimax^- 
Varimax 
Equamax 
A'-A 

Indep. Cluster 

Orthotran 

Subjective 



Factor Collapse 
12 , 42 
Factor Collapse* 



00 

too 

GO 
08 
18 
16' 

2(y 



42 
45 
40 
33 
4S 
44 
55 



/ 



1.72 

1 .75 

1.76' 

1.87* 

2.23,' 

1.93 

1.71 

2.06 



.81 

.84, 

.9/ 

.98 



.83 



•11 Direct w=0 

Oblimin w=-.5 
w=-l 

Indirect w=0 
Obymin w=.5 

w=l 
Quartimax • 
Varimax 
.' Equfimax • 
A'A 

, Indep. Cluster 
Orthotran - 
Subjective 



27 
•23 

23 
31 



72 
67 
65 
41 



Factor Collapse 
Factor Col.lapse 



00 
00 
00 
18 

35 
11 
48 



65 
69 
49 
32 
66 
64 
87 



1.47 
1.62 
l'.67 
1.89 



1.40 
1.44 
1.40 
2.33 
1 .42 
J. 40 
1.34 



.95 
.99, 

;99 

.87 



.98 . 

,95 ^ 
.82 ' 
.79 , ' 
.88 
.97 



12 Direct w=0 

. Oblimin, . w=-.5 

i Wr-1 

Indirect w=0 
Oblimin^ w=.5 
y w-1 
' Qiiartiraax 



38 
32 
31 
1.9 
32 
14 
00 



44 
■44 

45 
" 12 
^6 
6 

36 



1.51 
1.63 
1.53 
2.24 
1.53 
2.18 
K72 



.83 

.78 

.76 

.24. 

.77 

.32 

.58 



Tgble 2. Summary (Continued) 



Data 



Transformation 



Average 
Factor r 



\jyjperr 
' Rl ane, 
Cou i^ 



Average ' 
Variable 
Complexity 



Index 
of 

Congruence 





^,V'arimax 


00 


23 




Equamax 


00 


18 

1 




A'A 


26 


f 




Indep. Cluster 


56 


39 




Orthotran 


51 ' 


,40 




Subject 


54 S 


42 



1.85 
1.87/ 

^50 
1.49 
1.49 



.43 
.43 
.34 
M 
.93 



13 



14 



Direct w=0 


13 


61 v/. 


1.76 


,83 


Qblimin w=r,5 


13 * 


.63 


.• ' 1-7-6, - 


..84 


M W=-l 


12. 


63 


1.76 


: .84' 


Indirect w=0 


• 28 ; 


ll/«' 


2.62 


.81 


Oblimin w=.5 


/ 

12 


60 


' 1.75- 


.'■84 


w=1 


11 


53 ' 


1.9^/' • 


.84 


Quartimax 


00 


66 


' 1^77; " 


.99 


Varimax 


00 


67 


"1.78 ' 


.99 


Equamax - 


00. 


• 70 


1.78 


■ ,1.00 


A'A 


12 


18 


2.7-7.; 


. '1.00 


Indep. Cluster 


26 


38 


; 1.82 ^ ' 


' , -70 


Orthotran 


05 ■ ^ 


65 * 


1.77 


.98 


Subjective 


00 


70 ^ 


\.83 . 


1 


Direct w=0 


20 


116 *^ 


2.02. ■ ' ^ 


,91 


Oblimin w=*.5 


19 




2.04 


.87, 




. ' 19 


110 ' 


2.'06 


.85 


Indirect w=0 


14 


59 


2.-89 


.71 


Obi imin w^.'^S 


Factor Collapse 






w=l 


Factor Collapse 






Quartimax 


00 


101 


. . 2.09 . 


• .88 


Varimax 


00 . 


89 


- . 2.35 


.63 



Table ^. Summary (Continued) 









Hyper- 


Average 


Index' 






Average ' 


plane 


.Variable 


of 


Data 


Transformation 


Factor r 


Count 


Complexity ' 


Congruence 


14 


• ' <• 


00 


80 










lO* 










Indep. Cluster 


42 


108 


1.93 


.90 








n 1 - ' 


9' ni 


. o/ 




. Subjective 


25 


•pi ^ 


.. 1.97 . ' 


- 


15 


Direct w=0 


19 , 


69 


1.26 


' .93 




Obiimin w=-.5 


16 


68 


1 .29 


.94 




w=.l 


15 ' 


■ 63 


1.30 


.92 


• 


Indirect w=0 . 


Factor Collapse 








Obiimin w=.5 


09 


64 • 


1 .39 


.87 


• 


w=l 


27 


42 


1.64 


.73 




Quartimax' 


00 


53 


1.35' 


.75 




Varimax 


00 


53 


1 .48 


.81 




Equamax • 


00 


54 


.1.49 


".80 






13^ 


' 23 


1.72 • 


.55 




Indep. Cluster 


. 23 


70 


1 .24 

• 






" Orthotran 


26 * 


68 


J .24 


1 ,00 




Subjective 


'24 .. 


•~74 


1 .25 " 




16 


• ' , Direct w=0 


14 


148 


2.07 


.92 , 




Obiimin w — .b 


13 


146 


2'. 1 5 


.96 




w — 1 


13 . 


146 


2.20 


.98 


\ 


Indirect w=0 


Factor Collapse 


- 






Oblimin w=.b 


■ .09 


' 157 




.88 


• 


w=l 


Factor Collaps'e 








Quaftimax . 


GO 


131 


2.24 


.93 




Varimax 


GO 


118 


2.26 


' .99 




Equamax 


GG 


124 


2.43- 


.•90 


• 


A'A 


-11 


110 


3.50' 


.79 




Indep. Cluster 


26 


149 


2 14 


79 




Orthotran 


18 


162 


2.01 


.85 


X 


< 

Subjective 


28 


170 


2'. 05 ^ 






♦ 






9 
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Table 2. Summary (Continued) 



Data 



Transformation 



Average 
Factor r 



Hyper- 
plane 
Count 



Average 

Variable 

Complexity 



Index 

Congruence 



• 17 Direct w=0 

Oblimin W",5r 

• ■ VF-l 

Indirect w=0 . • 
Oblimin vi=.5 
w=l 

Quartimax • . 
Varimax 
- Equamax 
A'A 

Indep. CVuster, 
Orthotran 
• Subjective 

18 Direct * w=0 

Oblimin w=-.5 
w=-l 

Indirect w=0 
Oblimin w=.5 
w=l, ' 

Quartimax 
Varimax 
. A'A 

Indep. Cluster ' 
Orthotjan 
. Subjective 



.15 
14 
14 . 

Factor 
Factor 
Factor 
00 

00 ' 

00 

13 

32 

16 

13 

04 

03 
02 
20 
20 
GO 

ofy 

GO 
19 
99 

99^ 
99 



. .294 
294 
289' 
Collapse 
Collapse 
Collapse 
■ 256 
268 
248 
186 
280 
. 297 
289 

8 

8 
8 

8 ■ 

8 

0 

8 

0 

0 

8 ^ 

3 

8 



2.38 
2.38 
2.48 



2.61 
2.52 
2.75 
4.78 
2.42 
2.32 
2.60 

1-.04 
1.04 
1.04 
1'.j04 
1.04 
1.98 

r.oo 

1.98 
1.01 
1.01 
1.50 
1.01 



.93 
.93 
.96 



.81 
.96 
.71 
.78 
.73 
.84 



.81 
.81, 

;8i 

.80 
.80 
.63 
.81 
.63 
.83 
.88 
,95 
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error in approximating the subjective solution, was identiiF.ied. It was .decided 
that within each data set all indices 6f cengruence within 5 percentage points • 
of the highest index of congruence for that data set would be considered as 
b6ing amongst the best congruence va^lues for the set of solutions determined 
for that given data set, 5 percentage points being an arbitrary but necessary 
grror band. In Table 3 the 12 blind solutions are surmiarized with regard to 
their frequency of defining an adequate solution relative to the subjective^ 
criterion solutions/ as indices of congruence. ♦ . , 

Clearly evident in Table 2 is the susceptab.il ity of the indirect oblimia, 
toward factor collapse, coefficients greater than \.75 in the ^pattern matrix 
and factor intercorrelations of 1.00. Although. not reported in Table 2 it was 
found that direct oblimin weights that were positive and less than unity, , 
e.g. .5, -will also result in frequent factor collapse. It would seem that 
restricting atjeast the direct oblimin weights to zero or some value less than 
zero might serve as a guard against factor collapse. The use of 'the orthotran 
and Harris and Kaiser models, both models being based upon the orthoblique 
equations, will not by definition ever result in factor collapse. 

For all data sets there were indices of congruence greater than .90. This 
would suggest that all subjective 'solutions were^ reasonable from the perspective 
that indeed they could be achieved by a blind transformation solution. However for 
some data sets, there were blind solutions^ having a relatively low index ^f 
congruence but having a hyperplane count considerably higherHhan the other 
blind solutions. This woul<l suggest that there may be more than one adequate, 
solution f op' a given data set-, at least in terms of hyperplane count (see the 
orthotran solution of data set 16). 

Harman (1967) has indicated that as the indirect oblimin weight varies from 
zert) to unity the factors become less correlated. This study presents overwhelm- 

-•J 

r 25 



V 

"0 



13 . 

4 

ing evidence contr^adicting this generalization. When there are two factors* 

it appears as though the indirect obl^min weight of unity will always define 

an. orthogonal solution. _ However, in prany of the Instances of singularity with 

an indirect' oblimin weight of unity the average factor intercorr.elation (not 

reported) was very high, above .90. This 'cojitradictory evidence can also be 

' noted in the Table 2 values associated with .data sets 2, % 12, and 15. 
» ■• 

If one'were to plot the blind solutions in the two-space used for^the sub- 

. . ^. 

jective solutions certain "soljution regions" would appear. These solution 
regions would represent the domains into which a subjective solution would have 

i ■ * 

♦ to appear in order for the blind procedure defining the domain^to provide an ' 
adequate solution^ Thesefregions are bounded by .very irregular lines and seem 
only to exist for the poorer blind procedures." This would, suggest that there 
are additional dimensions of description for factor solutions that appear to 
have an influence on certain blind procedures ♦ Although we note this interest- 
ing observation it is not of great consequence becaus^e there are blind procedures 
which functioned^ quite well with the data samples regardless of the data ^ * ' 
properties ♦ 

No one orthogonal solution showed enough consistency in providing accurate 
representation of the subjective solutions to really warrant further consider- 
ation as .a pragjnatic blind transformation procedure. Although it Is frequently 
argued that orthogonal solutions provide an interpretative picturr^f the under- 
lying factor structure with a poor hyperplane count the results of this study 
do not support this particular argument. The index of congruence does not ' 
really take into account the levels of the coefficients only their, patterns 
with regard to those of the subjective solution. Therefore if an orthogonal 
solution, regardless of its hyperplane count, provides a reasonably c^pod re^re- 
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Table 3. Frequency^ summary of best blind solution relative 
to subjecjtive solution. 



Blind 
Procedure 



Frequency 



Percent 
Hits 



Direct w=0 
^ J^blimin 

* Indirect w=0 
Oblimin w=.5 
w=l 



Qu.artlmax , 
Varimax 

Equamax 
A'A , ' 
Independent Cluster 
Orthotran - ^ 



8 
'9 

8 
4 

3 
2 

6 

7 

♦ «' 

4 

2 

8 

15 



44 
50 

44 

22 

17 
11 
33 
38 
22 
11 
44 

as 
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sentation of the patterns of the coefficients in, the subjective srolution, 
then one would expect a high ind^x of congruence, but this occurred for less 
than half of the data sets, mainly with those having an Average intercorrelation 
of approximately zero. 

For' 13 of the 18 data sets one or more of the ^direct oblimin solutions pro- 
vided a highly accurate solution. Unfortunately we were unable to^etermine 
either q priori or a posteriori which particular direct oblimin weight would 
define either the best solution or the poorest solution. According to the 
results presented in Table J if one were to, select any particular weight to use 
consistently, they would obtain highly accurate solutions, based upon our data 
samples, at best only 50 percent of the time and at worst only 44 percent of 
the time. Alternatively if they were to vary the weights from solution to 
solution they might obtain an accurate soltuion only 17 percent of the time/ 
^ The Harris and Kaiser (1964) A' A soltuion appeared to be particularly ini^ 
appropriate fo.r the data samples. For a number of data sets it defined extreme- 
ly complex solutions. Alternatively the independent cluster^' mode? which assumes 
variables of unit complexity did comparatively well in defining adequate sol- 
utions, which *1s probably why it is so popular. 

The orthotran solution unlike the rest of the, blind solutions had an over- 
whelming tendency, 83 percent of the time, to define a solution that was accur- 
ate with regard to the subjective solution. 

Conclusions 

Several important conclusions seem warranted, however caution must be • 
exercised with regard to the absolute generalizabil ity of the findings of this 
study. Although every attempt was made to^obtain data samples- from a variety 
of sources in order to obtain data representative of the universe of possible 
factor soluti6ns, we have no guarantee that this was accomplished. A second 



.15 

ma-jor limitation of this study is that the index of congruence may be a very 
rough measure of the fit of a transformed solution to a subjective solution 
and the 5 percent range may be an underestimate of the error of this^ index. 

^ertainly it is in order to recommend the totaf' abandonment of the indirect 
oblimin solutions. As a group they appear to be highly susceptible to factor 
collapse. They also had the lowest frequency ofv defining adequate* solutions. 

The Harris and Kaiser (1964)^A*A solution shojild also be abandoned. 
Although it does not transform to singularity it does tend to transform to 
complexity. It defined the most complex solutioji^for 15 of the 18 data sets. ' 

Assuming the 5 percent range^is appropriate it may be concluded that the 

I 

rthotran solution is the only blind transformation solution, of those studied, 
that is dati generalizable. However until its publication both as a manuscript 
(Hofmann, 1975) and as a computer program one should use a- direct oblimin 
(Jennrich and Sampson, 1966) solution with dte particular weight. The choice 
for the direct oblimin weight should be either zero or negative one-half. 
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